Apify

Apify and Crawlee Official Forum

Home
Members
!!!Joefree!!! 👑
!
!!!Joefree!!! 👑
Offline, last seen 5 days ago
Joined August 30, 2024
!!!!Joefree!!! 👑
·

Dataset FIELDS attribute

I have an integration actor that relies on the 1FIELDS1 attributes from the input dataset (payload). I retrieve this data by pulling from the API https://api.apify.com/v2/datasets/{dataset_id}, but it seems that the FIELDS attributes are not populated immediately. Even after looping up to 20 times with a 5-second interval, sometimes they still aren't populated. Am I missing something, or is there a better way to handle this? Any feedback would be really appreciated. Thank you!

Plain Text
⌛ ... pending #1 (158 rows, 0 fields)
⌛ ... pending #2 (158 rows, 0 fields)
⌛ ... pending #3 (158 rows, 0 fields)
⌛ ... pending #4 (158 rows, 0 fields)
⌛ ... pending #5 (158 rows, 0 fields)
⌛ ... pending #6 (158 rows, 0 fields)
⌛ ... pending #7 (158 rows, 0 fields)
⌛ ... pending #8 (158 rows, 0 fields)
⌛ ... pending #9 (158 rows, 0 fields)
⌛ ... pending #10 (158 rows, 0 fields)
⌛ ... pending #11 (158 rows, 0 fields)
⌛ ... pending #12 (158 rows, 0 fields)
⌛ ... pending #13 (158 rows, 0 fields)
⌛ ... pending #14 (158 rows, 0 fields)
⌛ ... pending #15 (158 rows, 0 fields)
⌛ ... pending #16 (158 rows, 0 fields)
⌛ ... pending #17 (158 rows, 0 fields)
⌛ ... pending #18 (158 rows, 0 fields)
⌛ ... pending #19 (158 rows, 0 fields)
⌛ ... pending #20 (158 rows, 0 fields)
❌ Error: Dataset EMPTY or COLUMNS unavailable!
2 comments
L
!
!!!!Joefree!!! 👑
·

Minor UI Bug

Unexpected Scroll bar on publication page when setting Categories
2 comments
O
!
!!!!Joefree!!! 👑
·

Actor reviews ?

Where can we see actor reviews ?
1 comment
O
!!!!Joefree!!! 👑
·

Minor BUG: Payout Links

Payout notifications point to wrong URL : https://console.apify.com/settings#/payouts
2 comments
S
!
!!!!Joefree!!! 👑
·

HELP: cant set my actor to Under Maintenance

It refused with error. Actor ID: rzyXiN9Abtpy4tkXs
15 comments
S
!
P
!!!!Joefree!!! 👑
·

BUG: on Integration Editor

On integration editor menu : "Edit Integration" point to wrong URL (non existed actor)
6 comments
S
!
!!!!Joefree!!! 👑
·

Minor Bug: README.MD

I use to be able to put image on README complete with width and height

<img src="https://example.com/image.jpg" width="200" height="300">

but now it seem the width and height is ignored , which makes my README uglier than ever before.
4 comments
o
!
!!!!Joefree!!! 👑
·

Web UI Bug ... again

I’m not sure if anyone else has experienced this or if it's just me.

When I don’t use an Actor for a long time, about a month or so, I sometimes notice that when I revisit the Actor console, the input fields are pre-filled by someone else, and I don’t know who. This is my own Actor.

These inputs may contain sensitive data like passwords, as shown in the screenshot.

I can't reproduce this issue, but my guess is that when my saved inputs 'expire,' they are automatically replaced by someone else’s inputs.

I hope someone from @Apifyteam can look into this.

Thank You!
7 comments
S
!
A
!!!!Joefree!!! 👑
·

Minor UI Bug 2024-10-02

The table Headers blocking the dropdown.
!!!!Joefree!!! 👑
·

Minor BUG 13-09-2024

When a user share their run, it seem my theme preference is "infected" by the view
although I am using "Light Theme", I view the run in "Dark Theme"
1 comment
!
!!!!Joefree!!! 👑
·

Question: About docker image size

Hello Team! Does reducing Docker size will reduce loading time and make the Actor load faster ... or ... is it the same ?
Thank You!
5 comments
J
M
!
M
!!!!Joefree!!! 👑
·

Actor Standby Question

How to know if current Actor have StandBy mode enabled.
So.. the Actor can decide whether it should activate HTTP server or run normal Codes.
Is there any API or ENV variable that I could use ?

Thank You!
6 comments
!
L
!!!!Joefree!!! 👑
·

Docker RUN --mount

I am trying to use RUN --mount inside my docker :
Plain Text
RUN --mount=from=builder,target=/__src__ /python3 /main.py --setup


but it failed :

Plain Text
ACTOR: ERROR: Docker image build failed: the --mount option requires BuildKit. Refer to https://docs.docker.com/go/buildkit/ to learn how to build images with BuildKit enabled


I am still not familiar with docker creation. any clue how to fix this ?
Thank You.
2 comments
!
L
!!!!Joefree!!! 👑
·

Actor Static DNS

I just realized some Actor maintained by Apify could have static DNS address example: https://super-scraper-api.apify.actor
Is my Actors also have this DNS name ? If yes it could make things easier, for example the OAuth Authentication process
Thank you. 🙏🏻
2 comments
!
!!!!Joefree!!! 👑
·

BUG Report 2024-06-22: Use custom SEO details

I set my Actor "Use custom SEO Details", and saved successfully.
But when return to the setting page, its return to unchecked.
1 comment
P
!!!!Joefree!!! 👑
·

Suggestion: JavaScript Fetch Example

On API Console theres is example using CURL, but theres no example using the most used language in the world which is pure JS Fetch. Adding Fetch example may help users a lot.

eg:

Plain Text
const APIFY_TOKEN = "YOUR_APIFY_TOKEN"

var run_inputs  = { "location": "New York" }

var url     = "https://api.apify.com/v2/acts/9avOmybPQaoW1CDas/run-sync-get-dataset-items?token=" + APIFY_TOKEN
var headers     = { "content-type": "application/json" }
var options     = { method: "POST", headers, body: JSON.stringify(run_inputs) }

var response = await fetch(url, options).then(res => res.json())


add another language (PHP, ruby) example might useful to.
1 comment
o
!!!!Joefree!!! 👑
·

Bug Report 2024-03-31: Can`t clear secret input

When I want to empty secret input, error show up
Error: Expected value to be of type string but received type "null"
7 comments
!
R
!!!!Joefree!!! 👑
·

Suggestion: Adding Batch Execution to the Run API

Currenly the Apify API doesn't support Array as input.
When we request run API with ARRAY input eg:

requests.post('https://api.apify.com/v2/acts/actorId/run-sync?token=********', json=[{'location': 'indonesia'}])

we get error something like :

{'error': {'type': 'invalid-input', 'message': 'The input JSON must be object, got "array" instead.'}}

Instead error, the API should accept the input as Batch Execution request just like Apollo GraphQL can do: https://www.apollographql.com/docs/router/executing-operations/query-batching/

Advantage:
The Actor only load Docker file once (save load time), then execute Scraper Code multiple time with multiple INPUTS, creating multiple Datasets for each INPUTS.
The run output should also return ARRAY of run results.
1 comment
S
!!!!Joefree!!! 👑
·

Multiple (hundreds) Checkbox INPUT

What is the best way to replicate this INPUTS into INPUT_SCHEMA.json
10 comments
!
S
A
M
!!!!Joefree!!! 👑
·

Can't find my actor anywhere in the store

May be I should wait for one more day ...🤗
2 comments
!
H
!!!!Joefree!!! 👑
·

Actor FULL Strength

I have my actor all setup, readme, input schema, output schema. etc.
But I am still missing one step to have my Actor in Full Strength .... but I am not sure what is it ?
1 comment
S
!!!!Joefree!!! 👑
·

BUG Report 007: On dataset view, pagination is not working

On dataset view, pagination is not working
2 comments
!
O
!!!!Joefree!!! 👑
·

Boolean Input Scheme

My actor Input Scheme have hundred of optional BOOLEAN parameters (literally). When user not selecting any of the options, the platform set the default values to False (all hundreds parameters). This could create confusion ? How to prevent this from happening ? How to make platform just set True only for users selected options ? Thanks.
3 comments
!
A
!!!!Joefree!!! 👑
·

BUG: Sorting buttons missing

on https://console.apify.com/actors?tab=earnings sorting buttons is missing
2 comments
!
P
!!!!Joefree!!! 👑
·

BUG: Notification

I am receiving this notification, not sure where it come from.
1 comment
L